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A study was undertaken in six fall 1 978 courses a • 
lafgt midwestern university to examine possib'le biasing influences on 
student ratings oi insttucti.on brought about by pre-course 
♦^^P^'^a^j-oiis OI the course, ^tua^nt and course demographic variables 
wereWnaly2ed as possik^-e deter-miners of afflK:tive entry intb the V ' 
course. Thes^ data we^C examined for influence* on student ratings of 
instruction. It was asjced whetht^r or not evaluations a-re more" 
mfiueaced by student expt^ctations than by Student b^kground or 
course ci ra umstances. Finaixy, data werel examined for j^ias due to 
these oat-of-oiass factors versus attitufle change due fo instruction. 
It was'^rQi^nd tiiat students Drought to thb courses expectations for 
and opiaions abo-*t the inrstructbr \nd -coacse. ^hese levels of 
afrective entry -were created or influenced by several student and 
cpurse chdracteristi.cs. Higher grade level students more often 
b.rought positive expec^tions of coarse and instructor. Electives or ^ 
cour^ies ir. the. st udentP^ major tijeid tended to contain students with 
hign expectations. Pre-coursa gossip about courses also teijded to be. 
more positive than^, negative. Eesults suggest th^t faculty -are in 
greatf^r control or' student evaluations thao a,re the pre-course' 
opinio.ns of student/s or tne iemograpaic characteristics of the 
■students o;: course. A. ii^t of references and statistical tables are 
appended. (MSE) 
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The Influence of Student *s Affective Entry 
on Instructor and (bourse Evaluations 



Research on student ratings 



of instruction has demonstrated that ratings 
based on responses to objective items may be biased indicafeors of instructor' 
and course quality. A generdl concern of instructors is that ratings are 
greatly influence4 by condjLtions or circumstances that occur independent of 
the classroom experience; influences that are often out of the control of 
the instructor being evaluated. For example research has shown that student 
ratings are influenced, often in'.complex ways, by class size, elective-required 
status of the course, expected grade and potential use of the ratings (Feldman, 



1976, 1978). 



To dr.te, most of the studies examining biasing influences on -student 
ratings have examined the impact of course and student demographic factors ' * 
(Costin, Greenough apd Mengetp, 1971; Centra and .Creech, 1976; Marsh, Note 1). 
Few studies have investigated' biasing influences brought to a course in the 
way of pre-course expectations or the affective entry "level of the students. 
Cranzin and Painter (1973)^xamined the relationship , between cowrse .rat ings 
and the static and dynami/^^. e. , .reflecting change over time) attitudes of 
th« students as measured prior to the course and during the course, respectively. 
These static and dynamic attitudes were regr^sed on three .post-course ratings. 
However, the dynamic infKiencea analyzed in their study were obtaine^^by 
subtracting pre-course measurements from corresponding^ post-course measurements. 
As .Chermesh (1977) commented^ '^Their discussion and design overlooked many of 
the statistical artifacts that plague 'change scores' such as regression 
effects, floor and o^iling effects, and the veil known unreliability of such 
^suveo (p. 291)." Chermesh avoided such methodological problems in his 
study of student affect and course ratings. However ^ his two step caudal 
analys^is examined ^attitudinal assessments collected during the ^middle and end 
of the academic year, thus, ignoring the pre-course expectation^ of the students. 
Chermesh^ concluded that^lis study could have been Improved by the additioA of ' 
the pre-course measurement. ' . . ' 

In another study, Pai-nter and Granshin (r972) collected students' grdd.e 
expectations on the first and last day of class to examine the strencthfof ' 
relationship between change in course evaluation and change in student perception 
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of performance. They concluded that "students who revise grade expectations 
significantly more- often shifted their evaluation in the same direction 
(p. 78)/* Given these results the question could also be raised whether 
or not revision^ of student attitude toward the instructor aijd the course 
are also associated with changes in coursg evaluations* Or> what the 
effect of student ^attitude change on objective ratings of instruction^ 

The intent of the study was to examine possible biasing influences on 
student ratings of instruction brought atout by the pre-course expectations 
of the students. The study first attempted to identify factors Vhich create 
or affect the pre-course expectation of students. , Student and course 
demographic variables were analyzed as possible determiners of affective 
entry. Second, affective entry data was compared to course and student 
demographic information in terms of-their relative influence on student 
ratings of instruction. The question was addressed whether or not course 
evaluations are "more influenced by the expectations of the students than by 
the background o.f th^ student or the circumstances of the course. 

Finally, the validity of objective student rating^ of instruction was 
challenged through a fomparison of rating bias due to -out-of-class factors. 
e»g», pre-course affect and demographic information) versus in-class factors 
(e.g., attitude change due to instruction). Affective entry and exit data were 
used tp assess student attitude change and'^to test the hypdthesis that valid 
^measures of instructional quality should be more influenced by the instructional 
process (in-class factors) than by pre-course student expectations or demographic 
variables (out-of-class factors). 
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METHOD . 



Instruments 



^Pre-course data was collected through. the administration of two Instruments, 
the first instrument was an "Affective gntry Level Scale" developed by Deaton, 
Pogglo and Glasnipp (Note 2). The self report Llkert-type scale assesses the 
expressed affect of students prior to course Instruction (affective ^^Hyy level). 
The 48 item scale provides subscale scors on four affective entry dim* 
Affective Entry, Assuredness, Career Relevance and Internal/External 
Management (preference for student versus *teac her centered "course) , Sub^i 




reUai>ility coefficients (Cronbach's a) 'reported by the authors ranged frt 
\93 to .68. 



PiiMo administered was a demographic i^uestionnaire. - The questfonnairii 

^ollec^ed information about the students* grade level, sex, GPA and' school 

progression* (whether or not the student went directly from high school .to ^ 

college). Also included on the questionnaire were questions about the ' 

elecftivity of the course (wherein the^ questionnaire was administered); c 

whefther or not the course was in the student^s major or 'minor field vof study; 

th^ amount of pre-^ourse "gossip" heard about the course; the degree to wMch 

if ;' ^ ' * > ' • 

stildents "looked forward'* to the cdurse; ex^pected course grade; and students* 

pre-course, opinioiYS (positive, no opinion or negative) about' thfe course and 
the instructor. t>. . ' ^ ' > . 

Post course information was collected through administration . of "the 
Instructor 'and Course Evaluation System (ICES) studenrt rating Questionnaire 
(Office of Instructimial Resources, Note 3) . JUICES is a QJafeterla^-type", 
sti^ent rating aya^eb which permits, «ach inatfuctor to "seledt his or her own 
evaluation items.^' However, the fiifst three 'evaluation i*tem6 on thSj questionnaire 
the same for each instruc^for ♦ ' The three itpms, global *in c'ontjBntj 4re 
e the course content, Rate the inpttuctor, and Rate the TrourBe In general, 
ents indicate their response^ on a .si)j point ^cale dnchpredk by. \^poor*^' and 
"exfcel,lent." For purposes of the study^ only respOtlees to'jttie lattep two 
globar items were analyzed. In add^.tion, students were dlso a'sked at/the 
end "Of the course to indicate theii' post-course oJitnionB (positive, no' opinion, 
or negative) about^ the^course and the inj^truct;5t and th^ir* expected ^^rade in 
the course. , V**^ 

, ^' ' . ■ • 

^ * s , 

Data Collecti on . ' • ^ / 

Subjects were 553 students enrolled in six fpll^ * 78' semester' courses at a 
large iJiidwestern universit^y. ^ncluded^Jwere tliree'jg^duate and three 
^ undergraduate level courses in ec'Sn6mfcs,x$^ucat^oj||^ O^njd psychology. On the first 
day of instruction, prio?: to ^ any. instructor coimnentsi s\:u<lent8 were as4«ed to 
complete the ..affective- entry^'scale and the dem^^graphic questionnaire. Students 
were guaranteed respoifte ^inonymity. Dufln» thfe last weeK of the semester, 
students vl^ere administered tlpe ICl^S ^questionnaire. Students* pre- arid po^t-course 
data were aomblnedj^'o p'^ovide 43^ matched data setfs. \ 



A. 



Data Analy sis 

- ■ ^ ^ ^ 

, To identify factors which create 6r affect the pre-course expectations of 
' students, Pearson producr moment correlations were computed between the student 
and course demographic variables (e.g.. GPA, sex, major/minor course) and the 
affective entry variables (e.g., subecale scores and pre-course opiniT>n8 of 
instructor and course). A second analysis compared „ course and student 
demographic information with affective entry dat'a in »terips of their 
relationships to student ratings of instruction. Step-wise multiple- ' . ' 

•regression analyses were conducted, employing -the .(5ourse and student 
demdferaphic variables and af^^ctive entry data as predictors and student 
responses to evaluation items—Rate the instructor and Rate the course In 
general — as criteria. 

Final analyses examined rating bias due to out-of-class factors 
(e.g., pre-courae affect and demographic Inf armation^ versus in-class 
factors (e.^. , attitude change due to instruction). Similar step-wise* 
multiple regression analyses as those previously cited were carried out with ' 
the addition of attitude change predictor variables. Attitude change Variables 
were .dummy coded variables created from discrepancies in students' pre- and - 
poat-Gourse opinions. In total, t^ree dummy coded -variables were cheated for 
each student attitude toward the course, ^he instructor and expected grade. 
-Dummy coded variables indi.^ated whether or not a student made a positjive, 
negative, or no shift from their initial^attltude. ^ *M • ^ 

Differences in student ratings duetto in-cla^j^ attitude change wer* further 
^.nvestigated through computation of separate one-way analysis of variance 
statistics employing type of attitude shif l^^ositive, negative and no change) 
as independent variable anc; student response^o the first two global 
evaluation items as dependent variables. Res/tant F-ratios and Scheffg 
post hoc statistics were tested at a .01 le#l of significance. 

^ RESULTS ^ 

Relations hip Between Demographic and Affective Entry Variables 

Correlation, coefficients between student'and course demographic variables, 
and affective entry variables are presented in Table 1. Due to .the rather large * 
sample size many of the correlation^ were |^at is t leal ly significant (p < .01). 
However, the size rff only a few of the correlations are of "pract ical" significance. 



ERIC,. 



The most, noticeable Velatlottships found between demographic and *af f ectlve entry 
variable^ were due to the influences of grade expectations* Students Who 
expected. higher course grades than others demonstrated more positive 
affective entry, more confidence in their ability to perform in the course, 
'greater expectations for the course and more* positive pre^cpurse opinions • 
about the course and the instructor • It was also evident that this same group 
of students desired a student versus teacher centered course. 

^ , Insert Table 1 

Other sizeable relationships revealed that students found elective courses 
and courses in their tpajor field of study to be more career relevant ♦ Students 
in maj6r field of study courses also reported greater expectations for> the course. 
Upper level students (i.e.,' seniors and graduate students) reported higher 
pre-course attitudes toward^ the i^nstructor than did lovfer level students. Also, 
the more gossip students reported hearing about the course prior to instruction, 
the more positive were their affective entry and pre-course opinions about the 
course and the instructor* ^ 

Relationship Between Demographic and Affective Variables and Student Ratings 

Correlations between demographic and affective entry variables and student 
ratings of the Instructor and th^ course are presented In Table 2. Overall, the 

t * 

low correlations demonstrated' weak relationships between either 'demographic or 
affective entry variables and student ratings. The affective entry variables were 
however, slightly higher related to the student ratings than wer-e the demographic 
variables. Positive relationships were identified between affective entry 
subscale score's and course ratings, and between pre^-course opinions of ^ the 
instructor and both instructor and course ratings* Greater student exp^tatlons ^ 
were also related to higher course ratings. The lone demographic variable 
related to both student ratings was grade lev^l. Upper levpl students assigned 
higher Instructor and course ratings than did iowerllevel students* 

•\ ~ ~~ — - — 

Insert Table 2 . . ; ' 

„ > 

The results of the* step-wise multiple regression analyses (Table 3) 
suggested that the strongest of the demographic and affective entry predlctprs 
were as follows: (1) for course ratings : grade level, affective entry subscale 



.'6. 

score, and pre-courge opinion of instructor (R = .397, p <..05); (2) for 
Instructor ratings ; grade level and pre-course opinion, of Instructor 
(R - ,340, p < ,05). For both criterion variables the low multiple R value 
reveals the weak predictive power of both demographic and affective entry 
variables. The strongest (yet still weak>^redictors of- course and instructor 
ratings were ccrrbinations of a single deraogra^W variable Vith one or two 
affective entry variables. 



Insert Table 3 

} ■ : 
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Relationship Between Affective Shift Variables and Student Ratinj^s 

Correlations between affective shift variables (positive, negative^ 
no change in attitude toward the course, instructor and expected grade)^ and 
student ratings of the course and the instructor are presented in Table 2. 
Affective shift variables revealed considerably higher correlations with student 
ratings than did either demographic or affective entry variables. "Negative 
shifts (pre- to post-course) in opinion about the course and instructor were 
. highly related to lower course and instructor ratings. In turn, positive 
opinion shif ts coincided wi^h higher course a^id instructor ratings, yet the 
8-trength of the relationships were greater for students demonstrating negative 
rather than positive shifts in opinions. Lower po&t-course than pre-course 

f w 

grade expectations were, also related to lower course and instructor ratings. ' 
Increases in student grade expectations were unrelated to changes in student 
ratings . 

Results of the second set of step-wise multiple regression analyses 
comparing in- and out-of-class factors as predictors of student ratings are 

, pres«nted in Table A. The« strongest of the demographic, affective entry and 
affective shift predictors w€re as follows:' (1) for c ourse ratings : 
negative course opinion shift, negative instructor opinion shift, pre-course 
opinion of course, negative gi^de expectation shift, grade level and 
exp>BC tat ions (R - ..749, p < .05); (2) for instructor ratings ; negative 

^ J-nstructor opinion shift, grade level, positive instructor opinion shift, 
pte-course opinion of instructor and negat^-ve course opinion shift (R » .831, 
p < .05). W^th the addition of the affective shift variables as predictors of 
student ratings sizeable increases in- the previously Computed multiple -R values 
were evident. In total, in-class factors such as the attitude change variables 

) 

■ S 
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were much stronger predictors of student ratings than were either demographic 
or affective entry variables. The strongest predictors of -course and ' 
instructor ratings were negative (in-class) attitude changes toward each 
respective criterion. 



Insert Vable, 4 



The influence of negative affective shifts on student ratings is further 
demonstrated through mean ratings (Table. 5) of students making positive, 
negative or no affective shift in their oplalon of the -course, the instructor, 
or their expetted course grade. For each triad of group means the negative 
shift group mean was significantly (p < .01) different from the other two 
grou'p means as determfned by Scheffe poet hoc .statistics coijiputed from 
significant ANOVA results. The single exception is found for instructor 
ratings and shifts in opinion about the instructor, wherein all three 
attitudinal groups differ signif icantly |f rom one another. . 




Insert Table 5 



DISCUSSION 



Stud(|nts brought to the courses examined in the study expectations for 
nd opinions about the instructor ajid the course. These opinions and 

^tions (or levels of- affective en,t;ry) were created or influenced by 
several >t;j^ent and' course characteri^t^s . Higher grade level students more; 
often reporte^Ki^sit^ve pre-crurse opinion^ about^heit injtructors than did' 
lower grade Iwel ^tydents. St;udents expecting to do well in the course also 
looked forward to the cb^rse. Elective courses or courses in the students' 
maj9r field of study tended contain atudents with high course^ expectations 
due to the perceived career relevance of such courses. ' Also' the more gossip 
students heard about a course the more positive were -their pre-course oplnipna 
of their instructors. .Student gossip (or recalled memories of gossip) seemed 
to be more positive than negative in nature. ' • 

^ With the Reception of the latter relationship the results are not very 
surprising, especially to instructors who compete for the privilege of teaching . 
electivev upper level courses in the students' major field of study. The self- 
selection process, r;ubjcct nr L Ler intero-t .-nd career -relevance are ' ' 
often cited as contributors to ,a high level of student motivation. (Doyle. 1975). 



,^ ^ While. the students appeared to possess pre^course opinions, ^these 
beliefs' ha'^ little influence on final course or instructor ratings* The 

low multiple correlsations xott,pUted in the analysis of demographic and 

^ ' /' ' ' 

affective entry variables as predictor's of final course ratings indicated 

that only a sm^U portion of the post-course rating variance couid be- 
explained by the student's attitudes and expectations brought tp the course*, > 
Instead, student ratings were best predicted by students* pre- to post-course ■ , 
changes in their opinions about the course ant^ the instructor. Attitude 
changes brought about by instruction (dependent on rather than independent 
of classroom activities) were the strongest predictors' of Hnal cours^ 
evaluations. The multiple correlations computed .with the' addition ..df 
attitude change predictors were greatly increased for both ratings criteria: 
course ratings (R - .38 to .75) and instructors ratings (R - .fS to •83); 

The regression equation for the prediction of course ratings also showed 
the diversity of i^ifluences on "Course in General" ratings. Negative opinion 
shifts toward the course, the instructor and the grade expected along with 
pre-course opinions of the course, student expectations and grade level were 
all significant predictors of course ratings. In contrast, significant 
predictors of instructor ratings centered more on instructor-only variables. 
Negative and positive opinion shifts of the instructor and p^e-course opinions 
of the instructor were three^of the five significant instructor rating 
predictors. Students seem to consider a wider range of factors when rating 
an"' entire^ course rather than just the instructor. 

In terms of student attitude change during the course, negative rather th&n 
positive shifts in course, instructor and expected grade opinions were 
significantly related to lower course and Instructor ratings. Only for 
instructor ratings were significant mean rating differences observed between 
individuals making positive and negative attitude shifts* It seems apparent 
that actions warranting negative shifts in attitude have a greater impact on 
students* evaluations than* do actions producing positive or no attitude change* 
Results seem to warn against a ceiling effect for expectation^, or the '^obl«n8 
of having stu^^tts bring to class pre-course opinions that are too high for the 
instructor to marntain or to improve upon during the course* ^ Positive instructor 
refutations may be as burdensome as they are complimentary. 
^ • ' . • ' ' " f 



* EDUCATIONAL SIGNIFICANCE' 

Student ratings of instruction were influenced more by in-clags ' 
(attitude change pre- to post-course) rather than out-of-class (student/ 
course demographic and affective entry) variables. The greater influence 
of factors dependent on rather than independent of the classroom experience 
lends. support to the validity of student ratings for administrative decisions 
in many of todays colleges and universities. Faculty support and confidence 
,in these rating systems is a critical component' of the evaluation process. 
-To date, faculty support has not been easily, if at all, achieved (McMartin 
anti Rich, 19-79'? Rich, 1976). While the study needs to be replicated in other 
courses and institutions, .^ifie ^results can be used to addAess faculty concerns 
about biasing influences on student ratirt^^ beyond their direct'j::ont'rol 
(i.e., student grade level, GPA; electivity of the coii^tse). Results suggest 
that faculty are in greater control of student evaluations than are the 
pre-course opinions of the students or the demographic characteristics of 
the students and the course^. ^ 
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VarUblea 



Student ; 

, Grade Level 
Sex 

Progression 

Grade Expectations 

Course ; 

Major /Minor 

•'Ele£tlv«f/Required 

Amount of Pre-Course ^ 
Goasip Heard 



, . , Tabi^ 1 . . 

Correlations Between Student and Coutse DeQCgrAphlc Variables and Affective Entry Vaclables (N.553) 



r 



I : — 

Affective ^suredness 
Entry ♦ 



.09 
.07 
.10* 
^-,07 
.30* 



.12* 
-.06 

.18* 



A- 

V- 

Subflcales 



Affective Entry^ V ar^ah^<»H 



.15* 
.02 
-.11* 
-.03 
.39* 



.03 
-.13* 

.09 



-.02 

.09 

t 

-.11* 
-.11* 
.lA* 



.40* 
.27* 



♦ 

.10* 



Career Internal /External 
Relevance Course Management 



.17* 
-.01 
-.11* 
-.03 

.22* 



.02 
-.07 

.08 



Pre-Coursc Pre-Course 
Opinion of Opinion of 
Inaitructor Course 


Expectations 


.16* 


,03 


.09 


-.17* 


.10 


.12* 


.07 


.^0 


.05 


-.11* 


' -.04 


-.06 


.13* 


.24*. 


.27* 


.01 


.09 


■ .16* 


-.05 


-.11* 


-.03 


.24* 


.18* 


• .14* 



Based on responses (Strongly Agre*, Agree, etc.) to: "I am really looking forward t}^ 



this course." 



P < .01 
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Sttident Ratings * i 
Rate the Instructor Raf the Course 



■ T«bl'e^2 , • 

Correlttlona Between Dsmogrephic. Affectlive Entry, and Affective 
Shift Var^bles and Student Ratings o f the Instructor and the Course (n-435) 

Deaographic Variables ! / , 

Q.P.A, 
Grade Level 
Sex 

Progression > 
Major /Minor 

Amount of Pre-Course Qossip Heard 
Expected Grade 



-.12* 
-.20* 
.07 
.12* 
.13* , 
-.02 
.05 



.10 
-.26* 
► 09 
.06 
.04 
-.08 
.11 



Affective Entry Variables i 

Affectlya Entry 
Assuredness 
Career Relevance 

V 

Intern^l/Extemal Course Management 
Pre-Course Opinion of Instructor 
Pre-Course Opinion of Course 
Expectations 



\ 



Affective Shift (Pre- to Post-Course) 

Positive Change 
No Change 
Negative Change 



Opinion of 
Course 



Opinion of 
Instructor 



Expected 
Grade 



Positive Change 
No Change 

Negative Change 

I 

Positive Change 
No Change 
Negative Change 



.13* 
' .00 N 
.04 
.12* 
.22* 
.03 
.04 



.16* 
.23* 
-.47* 

.49* 
.13 
-.75* 

.02 
.20* 
-.18* 



7 



r 



.27* 

.10 

.04 

.09 

.24* 

.13* 

.19* 



.15* 
» .37* 
(-.63* 

.28* 
.17 
-.55* 

« 

.01 
.24* 
-.25* 



p < .01 



ERIC 



17 



-2; - -3. 



Table 3 . 
•Step-W,ise Regression Analy«ls with Demographic arid 
Affecvive Entty Predlcr.orR anu Student Rat ing^: Criteria 



p w. ' ' ' ;■- 'Cri terion "■^<:ourse Ratings 

■■ Beta Weight t of Beta Weight 



Grade level \ ^ 237 A.A9** 

.f > 

AA^ectlve entry subscale score -.2^.2 ' ■ ' 4.'09** 

Pre-course opinion of instrcictot -.118 oi' 2.11* 

" (N « 33A) • •■ K = -;379** ' - /^r2 .144 



Predictor ' -^£^^^4^-^^^^"""^ ^^^ Ratings 

^''^^^'^^"^ Beta .m?{ht t of Beta WcighT 

— . ^ — ^?r— —i — ~ 



A. 70** 



Cradle level .251 
Pre-course opinion of Instructor -.l^i., . 2.96** 

' 334) R = .326** r2 = .106 

*p < .05^~~ ~ ~y~^ 
**p < .01 ■ ' ' 



r 



Table '4 

♦ 

Step-1;?iBe Regression Analyses wit;h the Addition 
of Affectivo. Shift Predictor Variables 



^PrecficY^r 



Negative f okr.^e opinion ahif t 
Negative iivMiPi^tor IMten sftift 
Pf*e-*Qour8e 
Neg&tive' gr 
Grade level 
Expectations 

O^v- 33 A) 





tat ion ghtf t 





JF oourse Ratinps 


Beta Weight 


m • t of Weight 


-.463 


— « — . ^ 

10.95** 


-.3.13 ■ 


7.65** 


-.Ul 


2.39* 


-■.129 


3.42** 


'.121 


3.15** 


-.118 


2.55 ' " ! 



Predictor 



Crjterlon =^ Instructor Rating 
Bigta Weighty t of Beta Wei^i 



Negative instructor opinion shift 
Gradife level ' 

Positive Instructor opinion shift 
Pre-course ^opinion of irfs^ructor 'J^k^ 
Negative course opinion shift 

(N - 334) • R « .831 




.05 



P < .01 
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Table 5 / ■ 
M»an» and Standard Deviations, of Student Ratings 



Affective Shift 



Opinion of Instructor' ; 

■ ,'.1 

Positive shift 

No sh'lf t / , j \ 

I ♦ 

Negative shift 



by Affective Shift Categories 



Student Rat'ings 
Rate the Course Rate the Instructor 



SD 



(n»165) 4.84 .95 
(n«llf)) /,.78 ' .95 
(n°150) 3.78* 1.31 



2 



SD 



(n°165) - 5.35 .73 
(n=118) 4.88^ 1.07 
(n»152) 3,39* 1.57 



Opinion of Cou rse : ' ■•; 

> . I ; 

Positive shift ;j ' , 

i 

No shift 
Negative shift 



(n»108) 4.72^ .86 
(n>174) 4.93^ .84 
(n«i49) 3.71* 1.3,7 



(n-108) 4.91 1,14 
(n-176) 4.96 1.19 . 
Cn-lSl) 3.78* 1.62 



Expected Or a d ex 

' — *~r~ ' 

Higher post-course grade 
No shift 

Lower post-course grade 



(n"» 43) 4.61 1.26' 
(n-167) 4.76 1.06 
(n'«221) 4,20* 1.^2 



» 

(n" 43) 4.63 1.66 
(n-168) ^4.86 1.34 
(n»224) 4,27* 1.44 



*Group mean is significantly different (p < .01) from the other two group means 
vdthln the triad based on Scheff^ post hoc statistics computed ' from significant 
ANOVA results. 
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